Master Flow

Advanced users can construct a master flow, which can contain advanced pipeline and flow logic, multiple data flows or decision flows and interactions with various other tools like APIs, command line and messaging. The master flow is a powerful feature that provides users with the flexibility to perform complex data cleansing and manipulation.

The following tutorial video demonstrates Master Flows for a data pipeline:

Accessing the Master Flow

The Master Flow is designed for use by pro users, and is hidden by default.

To open the master flow:

  1. If it is not already selected, select Master Flow (orange arrow above) in the Model ribbon.

    2. This adds the Master Flow icon to the Modeling tabs.

  2. Click the Master Flow tab (blue arrow) to open the master flow on the canvas.

The master flow opens. Note that the master flow has a pink, rather than a yellow canvas. If you have already configured your data flow or model, those nodes will have been automatically added to the master flow.

Tip: You can click the expand option (green arrow above) to expand the panel and see the names of the different model views, as well as the tab icons.

Master Flow Nodes

General

The General nodes are used to perform a range of essential functions, like adding data flows and models to the master flow, running SQL queries against the database, calling REST APIs, and more.

  • Click here to learn about the general nodes.

Loops

Loops are used to execute a node or process repeatedly based on a given condition.

  • Click here to learn about loops.

Conditional

Conditional nodes are used to determine the execution of subsequent nodes dynamically, based on a given condition.

  • Click here to learn about conditional nodes.

Messaging

Use the messaging nodes to trigger an email or SMS. Both the message distribution list and the content may be static or dynamic.

  • Click here to learn about messaging.

Node Context Menus

You can select and right-click any node on the Master Flow canvas to open its context menu:

Execute nodes

The Execute options are shown where exactly one node is selected:

  • Execute Node: Execute the selected node without executing any other nodes.
  • Execute and Continue: Execute the selected node and then each of the nodes that follow it in the Master Flow.
  • Click here to learn more about executing nodes

Clipboard tools

Clipboard tools are shown on the right-click context menu when any node or set of nodes is selected on the canvas:

  • Delete: Delete the node.
  • Duplicate: Create a duplicate of the selected node.
  • Copy: Copy the node to your clipboard.
  • Paste: Paste a copied node.